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ABSTRACT 



A method of measuring bloddness in a video signal gener- 
ates a power spectrum for a video field of the video signal. 
The largest peaks of the power spectrum at the higher 
frequency end of the power spectrum are initially selected 
and a common frequency interval between peaks is deter- 
mined. The contribution to the amplitude of peaks at the 
common frequency interval by peaks at other than the 
common frequency interval are subtracted from the ampli- 
tude of the peaks at the common frequency interval. The 
average of the corrected ampUtudes of the peaks at the 
common frequency interval is obtained and normalized as aj 
blockiness metric for the video signal. 

7 Claims, 2 Drawing Sheets 
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HARMONIC MEASUREMENT OF 
BLOCKINESS IN VIDEO SIGNALS 

BACKGROUND OF THE INVENTION 

The present invention relates to the assessment of picture 
quality for video image signals, and more particularly to a 
harmonic method and apparatus for measuring blockiness in 
video image signals. 

In digital video transmission where bandwidth is 
important, such as transmission over satellite link, the video 
signal is subjected to varying degrees of compression to 
decrease the bandwidth required for each video channel. The 
compression standards typically used, such as JPEG, MPEG 
or proprietary variants thereof, are "lossy" — to achieve 
higher compression they allow distortions to occur in an 
image represented by the video signal. The amount of 
distortion is a function of the complexity of the image and 
of the number of bits per second (bit rate) a compression 
encoder is allowed to use. Ideally the amount of compres- 
sion is maximized while still providing a video image or 
picture to the customer that is free of disturbing artifacts. 

Current devices to analyze picture quality, such as the 
PQA200 Picture Quality Analyzer manufactured by 
Tektronix; Inc. of Beaverton, Oreg., USA, are reference- 
based. A video signal transmitted through a video system is 
compared with the original video signal as a reference video 
signal in a measurement device. The reference video signal 
is either stored in the measurement device or is transmitted 
via some other non-distorted pathway to the measurement 
device. Use of a reference video signal is necessary for 
extremely accurate algorithms, such as the Samoff Corpo- 
ration JNDmetrix™ human visual model algorithm. 
However, this means that measurements are only made on 
video signals whose contents are either known in advance or 
arc immediately available, such as double-checking an 
encoder at the source. 

Other potential methods of measuring discrete cosine 
transform (DCI) based codec degradations involve directly 
examining the coarseness of the quantization scale in the 
compressed video stream, optionally combined with a mea- 
sure of the complexity of the original image transmitted by 
some means outside the video channel — a form of com- 
pressed reference. This method is not as accurate, and in any 
case can only make measurements on compressed video, not 
video that has been akeady decompressed and potentially 
passed through other systems, including other additional 
codecs, prior to end-user delivery. 

What is desired is a method and apparatus that allows 
measurement of blockiness artifacts, such as incurred when 
compressing video using discrete cosine transforms, in 
situations where there is no prior knowledge of the blocki- 
ness period and in the presence of image-content generated 
noise. 

BRIEF SUMMARY OF THE INVENTION 

Accordingly the present invention provides a harmonic 
method and apparatus for measuring blockiness in a video 
input signal. A power spectrum is obtained for a video field 
of the video input signal as the Fast Fourier transform of the 
sum of the lines in the video line after edge filtering. The 
largest frequency peaks from the higher frequency end of the 
power spectrum are initially selected, and a common period 
for the peaks is determined representing a common fre- 
quency interval. The amplitudes of the peaks at the common 
frequency interval are corrected for the contributions made 
by peaks at one-half and double the common frequency 
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interval. The correaed amplitudes of the peaks at the 
common frequency interval are averaged and normalized to 
prodtice a blockiness metric for the video input signal. 
The objects, advantages and other novel features of the 
5 present invention are apparent from the following detailed 
description when read in conjunction with the appended 
claims and attached drawing. 

BRIEF DESCRIPTION OF THE SEVERAL 
10 VIEWS OF THE DRAWING 

FIGS. lA-D are graphic views of the spectrum of a video 
signal without and with blockiness and with spurious peaks. 
FIG. 2 is a flow-chart view of a system for measuring 
15 blockiness in video signals according to the present inven- 
tion. 

FIG. 3 is a block diagram view of an apparatus for 
measuring blockiness in video signals according to the 
present invention. 

20 

DETAILED DESCRIPTION OF THE 
INVENTION 

The basis for the present invention is the observation that 

^ spectra of video fields impaired with blockiness artifacts 
have a characteristic form, as illustrated in FIGS. lA-D. 
Such spectra of a video field are obtained by edge filtering 
each line carrying video luma content, summing all the 
video lines from one video field into one line, and then 
taking a Fourier transform, such as a Fast Fourier Transform 
(FFT), of the resulting line. 

FIG. lA represents a typical spectmm of a video field that 
is produced by video content in the absence of blockiness 
artifacts. This spectrum varies slightly from field to field, 

35 depending upon content, but the basic nature of its shape is 
preserved. FIG. IB shows the typical spectrum where 
blockiness artifacts are present in the video. Here the peaks 
. are located on integer multiples of frequency which is the 
reciprocal of the period with which the block boundaries 
occur. Ideally the peaks are all equal in magnitude, but the 
effects of implicit filtering may result in shapes such as 
illustrated in FIG. I C. Video content often is rich in images 
with sharp edges or which carry artifacts incurred from finite 
impulse response (FIR) digital filtering. In these situations t 

45 the situation illustrated in FIG. ID may result, where various 
peaks in the spectrum are present along with peaks that 
represent the blockiness artifacts. 

What is shown in FIG. 2 is a method of allowing removal 
of spurious frequency peaks in the spectrum from the 

50 measurement and thus allows identification and measure- 
ment of spectral content generated by blockiness artifacts. 
The large peaks from the higher frequency end of the 
spectrum are sorted from among the spectral peaks 
generated, and those spectral peaks that do not fall onto 

55 integer multiples of a frequency interval are rejected. By 
doing this, most spurious peaks in the spectrum are rejected 
and only the peaks generated by the blockiness artifact 
remain. TM, &mouot of blockiness present in the video is' 
then determined as some aggregate measure derived from 

60 these spectral peaks, one such measure being the average of 
t he, amplitudes of the p eaks. ^ 
Once the spectrum of the aggregate line is obtained, it is 
analyzed to determine the predominant spectral peaks and 
whether these peaks are regularly spaced, indicating blocki- 

65 ness. The first N discrete Fourier transform (DFT) 
coefficients, where N may equal 50 for a 512-point DFT, that 
correspond to the lowest frequency bins where most of the 
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natural picture energy is located are discarded. Then the implementation. The spectral coefficients greater than 256 

spectrum is filtered to obtain a smoothed baseline spectnim mirror those less than 256. 

which is subtracted from the original to obtain a normalized 4. Because the DFT calculates only integral frequency 
spectrum. This removes most noise, such as white noise, and bins, some error is introduced when harmonics fall on 
picture content energy from the spectrum. Then the largest s fractional frequency boundaries. Either a greater resolution 
P peaks in the spectrum are found, and this set is searched may be calculated, i.e., using a 1024-point DFT with zero 
for a common period. The common period corresponds to padding, or some form of interpolation. But with interpola- 
the predominant blockiness period in the image. tion spectral smearing occurs, causing several of the neigh- 
Once the predominant blockiness period is determined, ^^^^^ ^ ^° Kccivc energy from the fractional 
the amount of blockiness in that period is calculated. To do lO harmonic. The smaller tiie number of points in the DFT, the 
this the average harmonic peak height, after removing the ^^^^ accuracy and precision of the blockiness metric 
estimated contributions to the peaks from half and double degrades. 

blockiness period, is measured. Then the blockiness amount method described above derives an aggregate 

is scaled by the blockiness period to obtain a normalized measure of blockiness of the whole image, the method may 

blockiness metric that may be compared across different 15 be applied to local regions of a video image and the 

periods aggregate measure of blockiness may be obtained by com- 

Generally blockiness has horizontal and vertical compo- P°'*°f. " f^""" measures of blockiness weighted 

nents that are independent. As a tradeoff only the horizontal to a human vision filtering of the underlying 

component is computed above. To calculate the vertical . ^ - . ^ • . . i 

component, the horizontal blockiness detection above is run "^f ""8 now to FIG. 3 the apparatus required to imple- 

T * f • • 1 • * • ij 11 ment the method mcmdes a video signal receiver 12 which 

on the transpose of the original input image. Ideally a .l-j i^-ii? • 

• I,. . | ^ r i. converts the video signal to digital form so it may be stored 

blockiness implementation computes the spectrum of each * . 

line and a e ates b avera in rather than a re atin ^""^^ °*^'°^^P computer memory 14, and a filter 

ine an aggrega es y averaging, ra er an aggrega ing obtain the spectra as described above. Spectral peak 

first and computing the spectrum. This prevents the phase . . . ■ • . i_i i • • • . • 

u i • *• f j w Ti- c J- < *• *t- 25 miormation pertaming to blockmess impairment then is 

charactenstics of different fines from distorting the aggre- j i_ < , 

. - i_ *i_ r *L isolated, as described above, by an appropnate analyzer 18 

gate spectrum, i.e., cancefing each other out before the j . i i • • *f , 

magnimde is calculated. But this technique currenUy is ^''iJ'jo ""^"^""^ '^^'^'^ °° ^PP'^P""'^ 

prohibitively expensive, so a less robust implementation of rS. ^ ' , . r. i . • 

L * .u ui 1 • ■ * /u ■ * i\ J- • Thus the present invention provides a measure of blocki- 

measunng the blockiness in just one (honzontal) direction is . / . , c • . 

* J V / 20 nessusingfrequencyharmonicsby gene rating from an input 

video signal a power spectrum, selecting the largest peaks in 

1 . The amplitudes of the spectral coefficients between two spectrum, rejecting those that are not integer multiples of 
frames with equal amounts of blockiness are proportional to ^ frequency, finding the largest blockiness amount corre- 
the blockiness period, and the frame with the longer period spending to each set of peaks, and reporting the blockiness 
has proportionally more peaks in its spectrum. So if frame 35 ^^^^^^ f^^. ^he dominant set of peaks. 

1 has a blockiness period of 8 and frame 2 has a blockiness What is claimed is* 

period of 16, frame 1 has half as many spectral peaks at j mtihod of measuring blockiness in an input video 

twice the amplitude than the spectral peaks from frame 2. ^^^^^ ^sing harmonics comprising the steps of: 

The metric used to quantify blockiness takes this fact into « « „^ „ m « 1^ f*u • * 

7 . . ^ , . , generating a power spectrum for a video field of the input 

account by normalizing the blockiness result by the blocki- video signal* 

ness period. selecting a set of peaks from the power spectrum that fall 

2. If a frame contams multiple blockmess periods that ^ common frequency interval; and 

share common harmonics, i.e., 8 and 16, 8 and 12, etc., the determining a blockiness measure for the set of peaks, 

aggregate spectrum is distorted For the 8 and 16 case, for 3. The method as recited in claim 1 wherein the generating 

example, all of the spectral peaks for the blockiness period 45 comprises the steps of: 

of 8 arc increased by the contribution from the blockiness T,. . - . /^i / . . ■> 

. , , c •i.'i'i filtermg the video field to accentuate edges; 

period 16 energy. Without accounting for this possibility, . , r ^ ^ 

greater blockiness period 8 energy may be computed than is summmg the lines of the filtered video field into a single 

actually present. Conversely, to measure the blockiness ' ^ 

period 16 spectral peaks, even spectral peaks which coincide 50 performing a Fourier transform on the single line to 

with period 8 peaks are greater than odd peaks. This suggests produce the power spectrum. 

the following way to estimate the relative contributions of ^ method as recited in claim 1 wherein the selecting 

period 8 and period 16 blockiness energies: step comprises the steps of: 

Given the desired blockiness period P to estimate the sorting large peaks at a higher frequency end of tiie power 

spectral energy, the average energy of the odd harmon- 55 spectrum to obtain an imtial set of peaks; and 
- ics of period 2*P is computed and is subtracted from all searching the initial set of peaks to find the set of peaks 
the peaks of period P. The current implementation having a common period between the peaks, the corn- 
performs this first order correction for the potentially P^^^^^ defining the common frequency interval, 
common (P, 2P) second harmonic case, but not for the 'The method as recited in claim 3 wherein the sorting 
more general (N*P, M*P) case which tries to account 60 step comprises the steps of: 

for arbitrary shared harmonic configurations. discarding the first N discrete Fourier transform coeffi- 

3. If the goal is to calculate the blockiness metric at a cients representing the content of tiie video field cor- 
known period, there potentially is an improvement in effi- responding to the lowest frequency bins; 

ciency by just calculating the DFT coefficients at the desired filtering the power spectrum to obtain a smoothed base- 
frequencies directiy rather than calculating the entire spec- 65 fine spectrum; 

tnim. For example for a blockiness of 8, only the coefficients subtracting the smoothed basefine spectrum from the 

at 64, 128 and 192 need be calculated for a 512-point DFT power spectrum to obtain a normafized spectrum; and 
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finding the largest P peaks in the normalized spectrum as 
the initial set of peaks. 

5. The method as recited in claim 1 wherein the deter- 
mining step comprises the step of averaging the amplitudes 
of the set of peaks as the blockiness measure. 

6. The method as recited in claim 3 wherein the deter- 
mining step comprises the steps of: 

removing contributions to the amplitudes of the set of 

peaks added by peaks at one-half and double the 

common period; 
measuring an average harmonic peak amplitude of the 

peaks at the common period to obtain a blockiness 

amount; and 
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scaling the blockiness amount by the common period to 
obtain a normalized blockiness metric as the blockiness 
measure. 

7. The method as recited in claim 6 wherein the removing 
step comprises the steps of: 

averaging the amplitudes of peaks at the odd harmonics of 
twice the common period to produce an average ampli- 
mde contribution; and 
' subtracting the average amplitude contribution from the 
amplitudes of the peaks at the common period. 

* + * « * 
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